Weighting for External Validity∗
نویسندگان
چکیده
External validity is a challenge in treatment effect estimation. Even in randomized trials, the experimental sample often differs from the population of interest. If participation decisions are explained by observed variables such differences can be overcome by reweighting. However, participation may depend on unobserved variables. Even in such cases, under a common support assumption there exist weights which, if known, would allow reweighting the sample to match the population. While these weights cannot in general be estimated, we develop approximations which relate them to the role of private information in participation decisions. These approximations suggest benchmarks for assessing external validity.
منابع مشابه
Conditional reliability of admissions interview ratings: extreme ratings are the most informative.
CONTEXT Admissions interviews are unreliable and have poor predictive validity, yet are the sole measures of non-cognitive skills used by most medical school admissions departments. The low reliability may be due in part to variation in conditional reliability across the rating scale. OBJECTIVES To describe an empirically derived estimate of conditional reliability and use it to improve the p...
متن کاملModeling mechanisms of perceptual learning with augmented Hebbian re-weighting
Using the external noise plus training paradigm, we have consistently found that two independent mechanisms, stimulus enhancement and external noise exclusion, support perceptual learning in a range of tasks. Here, we show that re-weighting of stable early sensory representations through Hebbian learning (Petrov et al., 2005, 2006) can generate performance patterns that parallel a large range o...
متن کاملProject Aims Original Methodology Literature Search General Physiological Psychological Validity Procedure Social Indicators Progress towards the Aims Modified Methodology Presentation Progress with New Procedures Tfiermoheter •reference Period Validity Weighting
متن کامل
A systematic review of publications assessing reliability and validity of the Behavioral Risk Factor Surveillance System (BRFSS), 2004–2011
BACKGROUND In recent years response rates on telephone surveys have been declining. Rates for the behavioral risk factor surveillance system (BRFSS) have also declined, prompting the use of new methods of weighting and the inclusion of cell phone sampling frames. A number of scholars and researchers have conducted studies of the reliability and validity of the BRFSS estimates in the context of ...
متن کاملAn appraisal of the Peer Assessment Rating (PAR) Index and a suggested new weighting system.
The PAR Index was developed to measure treatment outcome in orthodontics. Validity was improved by weighting the scores of some components to reflect their relative importance. However, the index still has limitations, principally due to the high weight assigned to overjet. Difficulties also arise from the application of one weighting system to all malocclusions, since occlusal features vary in...
متن کامل